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INTRODUCTION 


The purpose of reorganization is to allow-the user to alter the 
physical and/or togical description of an existing data base» 
with maximum system assistance in the restructuring of the data 
base yet with a miniaum impact on user prograas which reference 
the data base. : 


The UPDATE capability first provided in the 6.0 release» allows 
the user to add or detete structures from the database as long as - 
it requires no restructuring cf the continuing database. The 
only affected programs are those programs which use deleted 
information or desire to use the new information. These programs 
have to be changed and recompiled. . 


To use the UPDATE capabilities» the user compiles a description 
of the new data base. This description is. preceded by an SUPDATE 
card» to indicate to the Data and Structure Definition Language 
CDASDL) that this is an existing database and a comparison of the 
eld and new descriptions is required. As long as the differences 
between the two descriptions satisfy the rules of legal changes» 
then the new dictionary and library files supersede the old ones. 
No changes are made to the database. The version stamps of att 
existing structures are unchanged so that user programs are 
unaffected unless they access deleted structuress tn which case 
they get a VERSION ERROR when they attempt to open the database. 


The reorganization capability allows the user to redescribe the 
database (with any implicit physical or lLogicat changes) and/or 
to explicitly request that special reorganization functions be 
performed on the database. . . 


Reorganization is accomplished by first running a DASOL 
compilation with a SREOQRGANIZE card. and the redescription of the 
database and/or requests for special reorganization functions. 
DASDL produces a special reorganization controt file which 
_ describes the particular changes that must be made to the 
database to accomplish the reorganization. DASOL then makes 
copies of the reorganization programs» binding them to this 
particular database and appending a OMS path dictionary. The 
user, executes these special copies of the reorganization 
programss which then accomplish the reorganization process. 
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READER ANO WRITER PROGRAMS 


There are two. reorganization programs» “the reader 
COMS/REORG.READ) and the writer COMS/REORG.WRIT). Both are 
written in SDL. When DASOL copies and binds these programs to 


the particular database» it also changes the names to <database 
name>/REORG.READ for the reader and to <database name>/REORG.WRIT 
for the writer. Reorganization is actually initiated whenever 


the user desires» . by executing the reader. The reader | 
ziptexecutes the writer, extracts the information in the old 
database» . using the MCP access routines in most instances (via 
the COMMUNICATE operator)» and then places this information in a 
queue file. The WRITER program accepts the information from the 
queue file and places it into the new database using» in most 
instances» the MCP access routines. At the corpletion of the 


reorganizations the new database dictionary is marked to indicate 
that the new database is valid and the old database Svel ee naty 1s 
removed. 


-If a lack of memory or disk space precludes these two programs 
and the two databases from being active at the same time» then 
tape may be used as the intermediate medium instead of the queue 


file. This is requested by including a STAPE card in the DASDL 
cospilation. The two programs will then execute serially» 
instead of the normal simultaneous execution. Disk may also be 


used» by OU-ing the tape file to disk at run time. 


If any OMS exception occurs during the execution of ‘either of 
these two programs (e.g.» if duplicates are not atltowed on a new 
set and the data in the old database includes duplicates), then 
the reorganization will terminates the new database will be 
warked unusable and ‘the old wit be marked as valid (but. not 
reorganized). 


If reorganization accesses corrupted data from the old database 
or if reorganization aborts (program failure or system failure)» 
then the old database may hecome unusable (see ABNORMAL 
CONDITIONS section). For this reason» it is advisable to dump 
Ccopy) the entire database before running reorganization. 
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AUDIT and RECOVERY wilt be unable to operate through an UPDATE or 
a reorganization. For this reason» and for backup» the entire 
database should be saved after a reorganizations also. 


RELAIED DOCUMENTATION | | 
NAME 1 7 ,) | ; NUMBER 


DASDL | Pe Se 2219 9433 
DMS AUDIT and RECOVERY | | P.S. 2219 0532 
B1800/81700 MCPII PeSe 2212 5462 
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DAIA BASE REDESCRIPTION RULES 


The following rules identify those changes that may be made when 
redescribing a database for reorganization. Rules marked with an 
asterisk (*) require a version stamp change and the necessary 
reconpilations (see VERSION CHECKING section). Further 
information on rules 1 through 8 is in the DATA TRANSFORMATIONS 
section. | 


*i. Items may be added to existing data sets (fixed or 
| variable format parts). These new ttems may be used as 
key items or may be required only if an initiat value 
was specified. : 


#2. Items may be deleted from existing data sets (fixed or 
variable format parts). , 


#3. Items sizes may be increased or decreased. This 
includes both the fraction and integer part of numbers. 
(Key items of ordered manual subsets may not be 
changed. ) e 


ah, Signs may be added or dropped on numbers. (Key items 
of ordered manual subsets may not be changed.) 


#5. Occurences may be increased or decreased. 


“6. Item types may be changed. (Key items of ordered 
manual subsets may not be changed.) 


«7. Groupings and/or levels may be changed. The items must 
be used within the scope of the same data sets in the 
old and the new database. 


*8. Items may move from the fixed format part to a variable 
. format part and visarversa. | 


«9. The ordering of the items may be changed. 
10. - Sets and automatic subsets may be added. _ 
*11. Set s and eutowntac subsets may be deleted. 
i2. Sets and automatic subsets aay change their duplicates 
clause. . 


*13. Sets and automatic subsets key items may be changed. 
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#14, Sets and automatic subsets gecendias and descending may 
be changed. 
#15. Index sequential sets may be changed to index random 
sets or automatic subsets. 
#16. Index random sets may ‘be changed to index sequential 
sets or automatic subsets. 
#17. Automatic subsets may be enanded to sets. 

18. Embedded data sets and manual subsets. may be added. 
#196 Embedded data sets and manual subsets may be deleted. 
x20. Ordered data sets may be changed to unordered. 
w2i. Unordered data sets may be changed to ordered. 

"224 Manual subsets with keys may be changed to manual 

) subsets without keys. : 

23. ALt of the physical attributes may be changed. These 


include: 


PRIME 
MAXENTRIES 
MAXRECORDS 


TABLESIZE 
MODULUS 


BLOCKSIZE 

AREALENGTH 

SPLITFACTOR (reorganization not required) 
AREAS 

FAMILYNAME 

TITLE 

SECURITYTYPE 


 SECURITYUSE 


A TITLE in the old database may only be used in the new 
database for the same file or for a file that is being 
reorganized. 
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#24, The conditions for automatic subsets may change. 


256 The conditions for VERIFYs may change. 


Note: The .comoarison on conditions 1s. for an 
equivalent expressions not for an identical 
expresston. . 
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DAIA IRANSFORMATIONS | 


During reorganizations data items within a data set may change in 
size» type» offset and number of occurrencess subject to certain 
restrictions which are discussed below. 


Data items may be added or deteted from the description of a data 
set. When a data item is deleted» the data associated with that 
item is removed from alt records in the data set. When aie data 
item -is added» a data field containing the initial value of the 
data item» if specified or nulls» is inserted into all records in 
the data set. Items which are added and do not have an initial 
value specified may not be used as keys or be required fields. 


Data item sizes may be changed. If the old size is greater than 
the new sizer» then data will be truncated from the item. This 
condition is detected by DASDL and a warning message is given. 


Data items may add or delete the sign fietd. Deletion of the 
sign field is detected by DASDL and a warning message is given. 


OCCURS nesting may go to three tevels in’ DASDL. A data item's 
number of tevels of nesting may change. A data itemw's number of 
occurrences may change. If the number of occurrences changes 
without changing the number of tLevels» then -each tevel is 
preserved and each subscript remains as it was. If the number of 
occurrences decreases in the new database» only the first na 
occurrences wilt be moved to the new record» -where n is the 
number of occurrences of the data item in the new data set 
record. This condition is detected by DASOL and a warning 
message is given. If the number of occurrences increases in the 
new database» only the first m occurrences will have data moved 
into them from the old data set records» where m is the number of 
occurrences of the data item in the old data set record. 


In transforming PERSON from database A to database 8B in Figure 
3-i»e the transformation would be as shown in Tabte 3-1la» and 
there would be three stots in database B without valid data. 
Going from B to A» three occurrences of PERSON would be lost and 
aowarning message would he given. 


If the number of levels changes» as from database A to database C 
in Figure 3-1» then the structure is recreated tinearty and the 
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old subscripts may have no relation to the news as tn the mapping. 
-Shown in Table 3-1b. 


JOB GROUP OCCURS 3 TIMES 
. ¢ eee 
PERSON ALPHA (19) OCCURS 2 TIMES, 


coe )7 


Figure 31a: Example database A 


JOB GROUP OCCURS 3 TINES 
¢ eo@n 
PERSON ALPHA (10) OCCURS 3 TIMESS 


coe )3 


Figure 3-ib: Exampte database 8B 


JOB GROUP OCCURS 2 TIMES 
C24 
308 ORDER occuURS 2 TIMES 
< @®# @ 8 
PERSON ALPHA (10) OCCURS 2 TIMES 
eee): 


coe 3 


Figure 3-ic: Example database C 
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A B. A C 
Cisl) Cis1) et C1») Cl»xls»1) 

Cie2) C12) . C122) Clels2) 
es (1,3) . 201) C1le2sl) 

(201) (€21) : C222) Ci»2s2) 

C222) (292) 2D C31) C2eivl) 
oma (23) C32) C2912) 

321) (31) . “== (27291) 

C322) €392) . see C2922) 

one  (353)'-: 


Table 3-1a: Mappings of PERSON between Figure 3-16 databases 
The grouping and/or levels of data items may be changed» subject 
to the. following restrictions: 


1. Regroupire of items may mot cause Foe to be 
duplicated. For example: ” . 


otd | new 


A GROUP | A ALPHAC2)3 
—(B OALPHACLD3 B ALPHAC1)3 
C ALPHAC1))3 C ALPHACL)3 


is forbidden. In this examples the data represented by 
A are duplicatec in the new definition» since B and C 
both contain data contained in the new A. 


Ze Regrouping of items may not cause multiple mapping of 

, information into an item. . This would occur if the new 
definition were transformed into the old definition in 
the example above. 


Item types may be changed. The only restriction imposed here is 
that a decimal or signed decimal item may not be changed to be an 
elementary alpha item (this is a COBOL rule). 


When DASOL detects that an. item must be transformed» it 
effectively generates a MOVE which conforms to the COBOL 
conventions. : 
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i truncation or ee {. ‘ ] 


1 space !tzero Izeroltrun-lgenerateltrans- 


MOVE t Filt UFfill Wfitticate Ipositivetlate 
SSS SeeseclceSSeeenesees=} On; 1 on, Von isigan | «sign 4 
FROM i To - lt right Irightileftt t { 
setssrscssslersssssesssss)} ess sss ) sess feoess| sees lee sssecs j esses 
] - | i ' i t | 
group t group i x i { q | | 
group § alpha t x a ’ i | j 
group 1 integer | ox f 1 i 1 x 
group 1 signed int.! a a | ' ] x 1 x 
group { decimal ! t x 1 1 - t x 
group ! signed dec.!| i x 4| a i x ' 

Se hlatatatatetatatel Kelatatatetetatatatetetel tetetatatatatel Ratatatetel tetetated Kaletatabel Kalatatetetatated Ratelatabahe 
alpha § group 1 xX | ] i 1 i 
atpha = t alpha J Xx | | § f oa 3 
alpha | f integer ~ 1. i ix i 4. | ! x 
atpha |! signed int.! ] a a | t x 8. xX 
atpha { decimal 1 i { x i ' xX 
‘alpha t signed dec.l 4 ' x1 | x i .x 
Salata taatatal Reletatetetatetetetatatel Keletatetatatel Retetatated tebetated Cabehtetel Retetetatetetatel Reltetetate 
integer i} group i x i ] 1 { t x 
integer | alpha ! -x i 4 t ! ' x. 
integer t integer | { i x { i 
integer | signed int.! ! § xi { x | 
integer 1 decimat 1 t ! xt ' '. 
integer 1 signed dec.! j ' x 1 ] x j 
le tetele taka Ralatel Rokatatatlaetatatetaled Cette atatal Retetelekel bekatatel Releteteted Ratetetetetatetel Relelatetate 
Signed int.! group i xX ] | !{ x 1 ix 
Signed int.! alpha {i x i ] ix | i sx 

‘signed int.! integer i | t $ xt x ] | 
Signed int.!] signed int.! { ' xi t t 
signed intel decimal ! i ! xt x fF. i 
Signed int.! signed dec.! | i exit ! | 
late t te tetatatel Relatatetelalatatatatated Retetetedatatel Ralataletel belelatel Kolatatekel Retalaletetatated Ratetatatated 
decimal ! group t xX t t ’ ! ] 
decimal § alpha ixerror« |] i- 1 ] ( 
decimal f integer | | i xi 1 i 
decimal 1 signed int.| | i xt ' Xx ! 

_ decimal i decimal . 1 _ 4 ioox-t ! i 
decimal ! signed dec.l J {$ x ft | x i 
lelatatatetatatatatel Cakalatetalatatatatatated Rabetatatatetel Rabeteteted tatetatel Retetatedel Katatatetatatated Retatetate 
signed dec.i group ! X 1 | ' x ft i 
signed dec.! alpha i*error*| 1 1 1 ! 
Signed dec.! inteaqer i | ' xt x | 
signed dec.! signed int.l 1 t x4 ! i 
signed dec.! decimal 1 i bx x I 
a1 sned dec.l signed decel i ix 4 | i 


Table 3-2: DASDL MOVES (COBOL Conventions) 
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If an item is moved from the fixed format part to any variable 
-format parts» the contents of that field wilt be lost in att 
records not containing the specified variable format parts. A 
DASOL warning will be given to indicate the potential loss of 
data. ‘ . 


If an item is moved from any variable format parts to the fixed 
format part» that item wilt be set to initial values if specified 
or to null in § alt records which did not contain the specified 
variable format parts. 


If variable format parts are eliminated» there can not be any 
records in the database which contain that variable format part» 
otherwise a data error exception will occur during Tec semieaeyeD 
and the a a will fail. 
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VERSION CHECKING 


Each structure and remap has associated with it a version stamp 
which reflects the Latest time that a change was made to the 
logical description of the databaser that would affect any 
programs which use that structure or remap. Any programs 
containing descriptions of a structure or remap with a different 
version stamp wilt get a version error. when the database is 
opened. A recompilation of the program is required to bring it 
up to date with the current description of that structure. This 
recompilation must take place after the successful completion of 
the reorganization process. The version stamp of a structure or 
regzap is contained in the LIBRARY file which describes its the 
LIBRARY files are not generated until the successful completion 
of the reorganization. Note . that whenever a structure is 
deleted» its version stamp is changed. 


Some of the changes that are tegat with reorganization will 
require that the version stamps of some of the structures or 
remaps change. The user should be aware of any changes requiring 
recompilation and the magnitude of the reconpilation effort 
required» before making any changes to the database. Atl of the 
reorganization rules marked with an asterisk (*) under Data Base 
Redescription Rules will require a version stamp change and _ the 
necessary reconptlations. 
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SPECIAL REORGANIZATION EUNCTIONS 


Special reorganization processing against the database may be 
requested by the user. There are two types of these functions: 
GENERATE and PURGE. These special functions are requested by 
including explicit reorganization statements in the DASOL source. 
These statements may be the only source input to the DASOL 
compiler or they may be included with a redescription of the 
database. In the .tlatter cases the exnlicit reorganization 
statements must appear after the database redescription. 


GENERATE STATEMENT 


During the normat updating of a database» the efficiency of the 
database may deteriorate both in terms of the amount of I/0 
‘required to access parts of the database and the amount of wasted 
disk space. 


The GENERATE statement causes. the reorganization programs to 
rebuild structures in the database» restructuring them toa 
increase their efficiency and “garbage collecting" excess disk 
space. 


Atl structures return unused disk space to their avaitable 
storage tist. However » there 3s no mechanism for returning 
unused file areas to the system. Thus» if a structure at 
sometime included a very large number of records and subsequently 
returned to a more typical size» none of tts unused physical 
areas would be returned to the system. The space would be 
available to that structure but may never be needed. A GENERATE 
on a $ structure causes the reorganization process to “compress” 
the structure and return unused file areas to the system. 


A GENERATE on a structures» besides "garbage collecting" unused 
spaces causes the reorganization process to rebuild the 
structures restoring it to a more efficient state. The specific 
effect on the structure and improvement in its efficiency is 
dependent on the structure type. 
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Syntax: 


“GENERATE -- <structure name> on nn ew ern en nnn nen nn e--- >t 
A i 
i_ CFAMILYNAME = <reorg-pack-id>)_! 


 Segantics: 


A GENERATE on a data set causes the reorganization process to 
read the data records in their physical order and store them into 
the new database. This also causes an implicit GENERATE on all> 
sets or subsets which reference the data set. 


A GENERATE statement on a manual subset causes the reorganization 
process to do a find for each entry in the old database and an 
. tnsert for each entry in the new database. In this way» manual 
subset entries which point at dead records or at records whose 
‘keys have changed will be eliminated from the database. However, 
an implicit GENERATE only causes a balance to be done on the. 
manual subset» and the addresses of the object data records to be 


adjusted. In this case» those entries which point at dead 
records are eliminated, but no check 1s made for matching key 
A GENERATE on an automatic set or subset causes the 
reorganization process to perform a balancing operation on the 
structure. The old structure is read by the reorganization 


programs and the tables are restructured according to the 
SPLITFACTOR and MAXENTRIES attributes. If the object data set is 
atso being reorganized» the addresses of the object data records 
are also adjusted. 


A GENERATE on an embedded data set or manual subset will cause an 
implicit generate on the parent data setr with the exception of 
an implicit GENERATE on a manual subset which only causes the 
manual subset‘'s structure heads to be adjusted in the parent data 
set records. 
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A GENERATE on an embedded structure wilt cause groups of records 
wtth the same parent record to occupy contigious blocks. 


The optionat FAMILYNAME clause atltows .the user to specify an 
alternate media for the GENERATEd structure. All intermediate or 
teaporary files used in the reorganization process for this 
structure will reside on the pack specified. See the section on 
FILE NAMING CONVENTIONS for more details. 


Syntax: 


GENERATE --- <disjoint data set name> S2non ere eee ee 


>>== CROERED BY -~ <ordered set> oo ne enn rn nn nn eee een nn en een nnn->7 
t east { 
f#_ CFAMILYNAME = <reorg-packvid>)_! 


Semantics: 


This variant of the GENERATE statement is the same in atl regards 
except that the data records will be read in the order of the 
ordered set rather than tn the data set's physical order. The 
ordered set must exist in the old database. 


PURGE STATEMENT 


The PURGE statement is the means by which the user may request 
that the reorganization process remove all records from a data 
sete break all relationships that have been established for a 
manual subset or recreate an automatic set or subset. A PURGE 
may be thought of as a deletion and addition of a structure where 
the newly added structure has the same structure number and 
version stamp as the deteted structure. It should be noted that 
a PURGE takes precedence over all other reorganization functions. 


Syntax: 


PURGE aa een ee wae ow <structure name> SSE ea ae es em ee ? aunanewan > ff 


IE lp ag NIE AE ee ag A ORE aM I OR ge IGE DRE ene Lag FOR or NM te ra ey eR ee ee ee ee Spee, He 
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Semantics: 


A PURGE of a structure causes its file to be retnitialized and 
ali information to be removed from ite When an embedded 
structure is PURGEd and its parent. structure is not PURGEd then 
the embedded structure's structure. head is set to null inthe 
parent data record. 


A PURGE of a data set causes an implicit purge of all its 
embedded structures and all sets and subsets which reference it. 


When an automatic set or subset is PURGEd and its object data set 
is not PURGEd» the reorganaization process rebuilds it from the 
data in the object data set. This is different from a. GENERATE> 
in that the GENERATE causes the reorganization process to rebuild 
the set from itself. 
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FILE=NANING CONVENTIONS 


The reorganization programs generate a number of teaporary . disk 
files that are used during the reorgaization of a database. The 
user should avoid naming his files in such a way as. to conflict 
with the names of these temporary files. 


A temporary copy of the database dictionary has the name: 
<database pack>/#<new database name>/ DICTIONARY. 


The <database pack> and <new database name> come from the compvite 
card of the DASDL compilation. 


If the RE ORG. READER and REORG.WRITER are run simultaneously» they 
communicate via two queue files: 


<old database name>/REORGQ and 


“old database name>/ERRQ 


There are five different types cf temporary files that may be 
.used for a structure in the dats bases 


1). <reorg pack id>/#<new database name>/#REORG:<structure number> 


This file is used for structures which are rebuilt by the system. 


2) <reorg pack id>/#<new database name>/#FIXUP?<structure number> 


This file is used for structures which are rebuilt by the 
reorganization routines. 

3) - <reorg pack id>/#<new database name>/#A7XRF3<structure number> 

This file is an address cross“reference for data sets which are 


reorganized. 


4) <reorg pack id>/#<new database name>/#XAREA?<structure number > 
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This file is used to faci titate changing the number of areas of a 
structure. : 


3) <reorg pack id>/#<new database name>/#SORT:<structure number > 


This file is used to sort the keys of an index random structure 
which is being converted froa the old table format to the new 
table format. 


The <reorg pack-id> is taken from the FAMILYNAME clause on the 
GENERATE statement. If no <reorg pack-id> has been specified for 
this structure then the structure's pack~id in the new database 
will be used. 


When the REORG.READER and-REORG.WRITER are run seriallys disjoint 
data hierarchies are passed from the REORG.READER to the 
REGRG.WRITER via a tape file. These files have the name: 


<old database name>/#DATAQ?:<structure number> 
where the structure number is that of the disjoint data set. 
Atl temporary files are removed automatically by the REORG.WRITER 


at the end of the reorganization process» along with all files in 
the old database which are not part of the new database. 
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ABNORMAL CONOLIIONS 


Certain abnormal conditions may cause the reorganization to 


terminate prematurety. | §$.When this occurs the user needs to 
ascertain if the reorganization process -i5 restartable and if 
not» what action must be taken to restore the existing database 


to its state orior to initiating the reorganization. 


The termination of the reorganization may be initiated externally 
€progran DSed» Clear/Start» etc.) or internalty. When internally 
initiated» the reorganization programs witt notify the user 
whether or not they may be restarted. In generals» when the 
termination is externally initiated» the reorganization 15 
restartable. . . 


The reorganization process has two phases. In the first phase» 
no modification is made to the existing database. In the second 
phase» the reorganization will removes modify» and add files. If 
the reorganization terminates in this second phase and the 
reorganization is not restartablers the user should reload his 
backup copy of the database before rerunning the reorganization 
or continuing processing on the existing database. The user can 
identify which phase the reorganization was in by inspecting. the 
output from the reorganization programs. If that output is not 
available (when the reorganization terminated because of a 
Clear/Start) the SPO output maybe inspected for the wessage? 


"aeeee BEGIN FILE MODFICATION «*%e® . 


This message indicates that the reorganization process has begun 
the second phase. 


A certain class of nonrestartable errors occurs because of an 
improper specification of the database to. DASOL- Possibte errors 
of this type are: ; 


-- duplicates which occurred but were not specified as 
atlowed in the new database. 


<s a limit error on a file in the new database (e.g.» 
maximum tevel of. coarse tables exceeded» file size 
exceeded). 


“-- a data error because of failure to meet WHERE or VERIFY 
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conditions specified in the new database. 


=< attempts to reduce the number of areas ina file betow 
the maximum area number that has space attlocated 


(occurs eben only the number of areas is changed on a 
file). 


If the output from the reorganization process indicates that it 
terminated because of one of the errors listed above» the user 
must correct his ODASDL specifications before rerunning§ the 
reorganization. 
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The OMS subsystem of the MCP is used for much of the 
reorganization processing. However» there are several special 
algorithms implemented in the reorganization programs to provide 
functions that are not available in the DMS subsystems» or to 
provide speed benefits for frequently used = functions. The 
details of these algorithms are explained below. 


\ 


Indexed sequential is one of the speciat functions. The 


algorithms used in the DMS subsystem attempt to build and 
dynamically maintain a balanced tree structure;. however» 


additions and deletions tend to unbalance the tree structure. 
The balancing function reestablishes a balanced tree. It uses as 
inputs» the tables built by the DMS subsystem. 


Each entry is toaded in order into the fine table until the fine 
table is splitfactor full. The key of the last entry» together 
with the address of this fine table» ts then propogated up to the 
first level coarse tabte. The coarse table is also filted to 
splitfactor» and when that size is reached the last key and the 
table address is propogated up to the next tevet coarse table. 
New fine and coarse tables are allocated as necessary. When all 
entries are tloaded into the fine tables» the tast key of the tast 
fine table Catl bits on) is propogated up: through att existing 
levels of tables. The root table pointer 1s set to the highest 
level coarse table. During the process of filling tables» each 
level of tables are tinked together in logical order by a next 
and prior pointer. | 


Manual subsets are treated as a special case. If a data set to 
which a manual subset refers is reorganizedr then the addresses 
of the manual subset must be corrected to reflect the new 
locations of the data records. Garbage-collection of the tist 
structure is performed while correcting the addresses. 


The parent records of the manual subset are accessed in physical 
sequence. AS each is accessed» its entire manual subset is 
processed. First» there is a check for a fast subset (manual 
subset with one element and no key). If one 1s founds» then the 
address which is kept in the list head of the parent 1s corrected 
and the algorithm moves on to the next parent. Otherwise» the 
list tables are retrieved in a sequence determined by the list 
control information of the fist tables. Each entry is taken from 


8-2 


BURROUGHS CORPORATION ase COMPANY CONFIDENTIAL 


COMPUTER SYSTEMS GROUP ~ §81809/B1709 DMSII REORGANIZATION 
“SANTA BARBARA PLANT 7 | , P.S. 2219 0540 (B) 


the otd list» its address is correcteds then it is entered into 
the new tist. The new tist is compacted and atl space for 
deleted entries in the old list are removed by combining the 
entries from multiple old tabless untit a new table is filled. 
The List head in the parent record is adjusted to reflect the new 


list. Because the new list is built starting from the parent 
records the new List will have atl the. tables from a parent 


contiguous,» to take advantage of blocking and to mininize arm 
movement. ; 


Each time an address correction is made» the address is checked 
to ensure that the referenced record is stilt: valid. If the old 
address points at deleted recordsr then those list elements are 
not entered into the new list. This process results in new files 
for both the parent structure and the manual subset. 


If a manuat subset is reorganized» then the OMS access routines 


within the MCP are used to read the old tist and build a new 


If a’new set or automatic subset is added to an existing data 
sets then the DMS access routines in the MCP are used to build 
the new index. Firsts» the structure records are adjusted to 
indicate that onty the new index is to be built» then the 
reorganization uses the MCP access routines to rebuild the set. 
At the completion of the operation» the structure records are 
corrected. 


Another special function is the routines which convert pre-8.9 
index sequential and index random structures to the 8.0 format. 
These routines cannot be called directly by the user. They are 
used ty DASDL when the user requests a conversion of a prew8.N 
database to 8.0. The conversion process requires a 
reorganizations however the change to the new format indexes is 
the only process which will occur during this reorganization. 
The user may not request any other reorganization.during this 
execution. : . 
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